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@ Image processing Apparatus. 

@ An image processing apparatus of a digital copying machine or the like comprises : a color 
discriminating circuit to discriminate a color of an input image ; a discrimination image generator to 
generate a color discrimination image in accordance with the discriminated color; and a trimming 
circuit to trim a boundary portion between the color discrimination image generated and another 
image. A blank portion or a boundary line is fomned in the txjundary portion between the color 
discrimination image and another image. The trimming circuit can also trim a portion in the color 
discrimination image in the boundary portion. 
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BACKGROUND OF THE INVENTION 
Field of the Invention 

The invention relates to an image processing apparatus of a digital copying apparatus, an image scanner, 
a printer, a facsimile apparatus, a display apparatus, their interface apparatuses, or the like. 

Related Background Art 

In an image processing apparatus such as a d^ital copying apparatus, an original is illuminated by a halo- 
gen lamp or the like and a reflected light is photoelectrically converted by using a photoelectric conversion 
device such as a CCD or the like and, thereafter, the electric signal is converted into the digital signal and is 
subjected to predetermined processes, and an Image is subsequently formed by using a recording apparatus 
such as laser beam printer, liquid crystal printer, thermal printer, an ink jet printer, or the like. 

In association with the realization of a color image formation of a copy original or the like, an output of a 
large information amount is demanded. In recent years, a copying apparatus in which the color is partially 
changed and a color image is copied by using developing devices of a plurality of colors has been developed. 

A method whereby a color portion of an original is converted into a pattem and generated in order to show 
infonnation of a plurality of colors by a monochromatic printer or a display has been proposed in U.S. Patent 
No. 4,369,461. 

However, in the above conventional method, since a predetemiined color of an original is pattemed by an 
output apparatus of a monochromatic color, for instance. In the case where only the first color of a background 
portion in Fig. 19C has been pattemed, a resultant image is very hard to see so long as an image as shown In 
Fig. 19A1 was formed. 

Even in the case patterning both of the first and second colors of the original of Fig. 19C, it is falriy difficult 
to discriminate a background and an information portion as shown in Fig. 19A2. 

SUMMARY OF THE INVENTION 

It is an object of the invention to provide an image processing apparatus which can solve the foregoing 
problems. 

Another object of the invention is to provide an image processing apparatus in which when color infomnation 
is patterned or different concentrations are respectively assigned to a plurality of color infonnation and the color 
infomiation is displayed, the patterns or the concentrations can be easily discriminated. 

To accomplish the above objects, according to the invention, there is provided an image processing 
apparatus comprising: color discriminating means for discriminating a color of an input image; generating 
means for generating a pattern and/or a concentration in accordance with a result of the color discrimination 
by the color discriminating means; and trimming processing means for trimming a periphery of the infomnation 
image generated by the generating means. The pattem and/or the concentration can be easily discriminated 
by the trimming process and tiie image infomnation of the original can be easily discriminated. 

The above and other objects and features of the present invention will become apparent from the following 
detailed description and the appended claims with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the first embodiment of the invention; 

Fig. 2 is a diagram showing a construction of a color CCD image sensor 101 shown in Fig. 1 ; 

Fig. 3 is a timing chart showing examples of timings of CCD drive pulses shown in Fig. 2; 

Fig. 4 is a block diagram showing a construction of a CCD driver 133 shown in Fig. 1; 

Fig. 5 is a timing chart showing examples of timings in respective sections shown in Fig. 4; 

Fig. 6 is a block diagram showing a construction of a black correction circuit in a black conrection/white 

correction circuit shown in Fig. 1; 

Fig. 7 is a diagram showing the concept of black conrection; 

Fig. 8 is a block diagram showing a construction of a white conrection circuit in the black conrection/white 
correction circuit shown in Fig. 1; 

Fig. 9 is a diagram showing the concept of white correction; 
Fig. 10 is a diagram showing examples of data for a white plate; 

Fig. 11 is a flowchart showing a procedure of the white connection by the white conrection circuit; 
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Fig. 12 is a block diagram showing a construction of a color detection circuit 109 shown in Fig. 1 ; 
Fig. 13 Is a diagram showing a hue plane for explaining color recognition; 

Fig. 14 is a diagram showing a pattern generation circuit 1 1 1 and an address control circuit 1 12 shown in 
Fig.1; 

5 Fig. 15 is a diagram showing addresses and data in an ROM for a pattern shown in Fig. 14; 

Fig. 16 is a diagram showing a pattern; 

Fig. 17 Is a diagram showing timings of reference control signals; 
Figs. 18A to 18C are explanatory diagrams for explaining a trimming; 

Figs. 19A1 , 19A2, 19B. and 19C are diagrams showing the trimming according to the first embodiment; 
10 Fig. 20 is a block diagram showing the second embodiment of the invention; 

Figs. 21 A and 21B are diagrams showing filter masks for primary differentiation; 

Fig. 22 is an explanatory diagram for explaining a primary differentiating process; 

Figs. 23A and 23B are diagrams showing the relations between the primary differential value and the output 

signal; 

15 Figs. 24A to 24C are diagrams showing the trimming according to the second embodiment; 

Fig. 25-1 is a circuit diagram of the third embodiment; 

Fig. 25-2 is a block diagram showing a construction of a color detection circuit 259 of the third embodiment; 
Figs. 26A to 26C are explanatory diagrams of the trimming process according to the third embodiment; 
Fig. 27 is a block diagram showing a construction of a contour detection circuit of the third embodiment; 
20 Figs. 28 and 29 are explanatory diagrams of the trimming process of the third embodiment; 

Fig. 30 is a diagram of a color boundary detection circuit of the fourth embodiment; 
Figs. 31 A to 31 D are explanatory diagrams of the color boundary detection of the fourth embodiment; and 
Figs. 32A to 32C are explanatory diagrams of the trimming process according to the fourth embodiment. 

25 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Embodiments of the invention will be described in detail hereinbelow with reference to the drawings. 
Fig. 1 shows the first embodiment of the invention. 

Fig. 1 relates to an example of an image processing circuit apparatus. A full-color original is exposed by 
30 an exposure lamp (not shown). A reflected color image is photographed by a color CCD image sensor. A resul- 
tant analog innage signal is converted into a digital signal by an AID converter or the like. The digital full-color 
image signal is processed. The processed signal is supplied to a thermal printer, an Inkjet printer, a laser beam 
printer, or the like (not shown), by which an image is obtained. 

The original is first illuminated by the exposure lamp-(not shown). The reflected light is color separated 
35 every image by a color CCD image sensor 101. The respective color signals are read and amplified to pre- 
determined levels by an amplifying circuit 102. The color CCD image sensor 101 is driven by a CCD driver 1 33. 
Fig. 2 shows the color CCD image sensor 101 shown In Fig. 1. 

The color CCD image sensor which is used in the embodiment has total 3072 = (1 024 x 3) effective pixels 
because one pixel is set to 63.5 ^ m and each pixel is divided into three effective pixels of G (green). B (blue). 

40 and R (red) in the main-scanning direction as shown in the diagram for 400 d.p.i. (dots per inch) and 1024 pixels 
in order to read image signals by dividing the original into five regions in the main-scanning directions. On the 
other hand, five sensors chips 58a to 62a are formed on the same ceramics substrate. The first, third, and fifth 
chips 58a. 60a. and 62a are arranged on a same line LA. The second and fourth chips 59a and 61a are arranged 
on a line LB which is away from the line LA by only a distance of four lines, that is, 254 \m) (63.5 ^im x 4). When 

45 the original is read, the original is scanned in the direction indicated by an arrow AL 

Fig. 3 is a timing chart showing examples of timings of drive pulses shown in Fig. 2. 
Among the five CCD chips, the first, third, and fifth chips are independently synchronously driven by a group 
of drive pulses ODRV 118a and the second and fourth chips are also independently synchronously driven by 
a group of drive pulses EDRV 119a, respectively. Reference numerals 001 A, 002A, and ORS included in the 

50 drive pulses ODRV 1 18a denote charge transfer clocks in the sensors. Reference numerals E01A. E02A, and 
ERS included in the drive pulses EDRV 119a denote charge reset pulses in the sensors. The above clocks or 
pulses are substantially synchronously generated so as not to cause a jitter in order to limit mutual interferences 
or noises among the first, third, and fifth pulses and the second and fourth pulses. For this purpose, those pulses 
are generated from a single reference oscillating source OSC (not shown). 

55 Fig. 4 shows a construction of the CCD driver 1 33 shown in Fig. 1 . Fig. 5 is a timing chart showing examples 

of timings in the respective sections shown in Fig. 4. 

Clocks KO 135a which are obtained by frequency dividing original clocks CLKO generated from a single 
oscillating source OSC 558a are used to generate reference signals SYNC2 and SYNC3 to decide generation 
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timings of the pulses ODRV and €DRV. Output timings of the reference signals SYNC2 and SYNC3 are deter- 
mined inaccordance with set values of presettabLe counters 64a and 65a which are set by a signal line 22 con- 
nected to a CPU bus. Frequency dividers 66a and 67a and drive pulse generation circuits 68a and 69a are 
initialized by the reference signals SYNC2 and SYNC3. That is. the pulse groups ODRV 1 18a and EDRV 1 19a 

5 are produced by the original clocks CLKO all of which are generated from the single CSC 558a and by the fre- 
quency division clocks all of which are synchronously generated while using an input horizontal sync signal 
HSYNC 1 18 as a reference. Consequentiy, those pulses are derived as synchronized signals having no jitter. 
A disturbance of the signals due to interferences among the sensors can be prevented. 

The sensor drive pulses ODRV 1 1 8a obtained synchronously with each other are supplied to the first, third. 

10 and fifth sensors 58a. 60a. and 62a. The synchronized drive pulses EDRV 119a are supplied to the second 
and fourth sensors 59a and 61a. Video signals Vi to V5 are independently generated from the sensors 58a. 
59a, 60a. 61a. and 62a synchronously with the drive pulses and are amplified to predetermined voltage values 
by independent amplifying circuits 501-1 to 501-5 every channels shown In Fig. 1. The video signals Vi. V3. 
and V5 are transmitted through a coaxial cable 103 at timings of a pulse OOS 129a shown in Fig. 3. The video 

15 signals V2 and V4 are transmitted through the coaxial cable 103 at timings of a pulse EOS 134a. The above 
video signals Vi to V5 are respectively supplied to a video image processing circuit. 

The color image signals which had been obtained by dividing the original to five regions and reading the 
image signals therefrom and which have been supplied to the video image processing circuit are respectively 
separated into the signals of three colors of G (green). B (blue), and R (red) by a sample and hold circuit (S/H 

20 circuit) 104. Thus, after the color image signals were sampled and held by the S/H circuit 104, fifteen (3 x 5) 
kinds of signals are processed. 

Returning to Fig. 1 , the analog color image signals which have been sampled and held by the S/H circuit 
104 every colors R. G. and B are converted into the digital signals by an A/D converting circuit 105 every chan- 
nels 1 to 5. The digital signals are independentiy supplied in parallel to an aberration conrection circuit 1 06 every 

25 channels 1 to 5. 

In the embodiment, as mentioned above (refer to Fig. 2). an interval conresponding to four lines, namely, 
254 ^m (= 63.5 ^m x 4) is provided in the sub-scanning direction and the original is read by five zigzag sensors 
for the five regions obtained by dividing the original into five portions in the main-scanning direction. Therefore, 
there is a deviation between tiie reading positions of the channels 2 and4 which have previously been scanned 
30 and the remaining channels 1 , 3, and 5. To match the reading positions, such a deviation of the reading positions 
is con-ected by the aberration correction circuit 106 having a memory of a plurality of lines. 

Fig. 6 shows a construction of a black correction circuit in a black conrection/white conrection circuit 107 
shown in Fig. 1 . 

As shown in Fig. 7, in the black level outputs of the channels 1 to 5, there are large variations among the 

35 chips and among the pixels when an amount of light which enters the color CCD image sensors is very small. 
If such black level outputs are directiy supplied and an image Is generated, stripes or a variation occur in the 
data portion of the image. To prevent them, it is necessary to correct an output variation of the black portion. 
Such an output variation is corrected by the circuit as shown in Fig. 6. 

Prior to the original reading operation, the original scanning unit is moved to a position of a black plate hav- 

40 ing a uniform concenfration arranged in a non-image region of the front edge portion of the original base plate. 
The exposure lamp is lit on. The black level image signal Is supplied to the black correction circuit. With respect 
to a blue signal 8,^. in order to store the image data of one line into a black level RAM 78a. a tenminal A is 
selected by a selector 82a ((g) ). a gate 80a is closed (<g) ), and a gate 81a is opened. That is, data lines are 
connected such as 151a 152a 153a. On the other hand, a signal © is sup plied to a selector 83a so that 

45 an output 154a of an address counter 84a which is initialized by a signal HSYNC and counts pixel clocks VCLK 
is supplied as an address input 155a of the RAM 78a. The black level signal of one line is stored into the RAM 
78a (the above state is called a black reference value fetching mode). 

Upon reading of an image, the RAM 78a is set into a data reading mode. Data is read out of the RAM 78a 
every line and every pixel and is supplied to a B input terminal of a subtracter 79a along a path of a data line 

50 153a ^ 157a. That is. at this time, the gate 81a is closed ((g) ) and the gate 80a is opened ((g) ). A selector 
86a is connected to an A output. Therefore, for instance, in the case of a blue signal, a black conrection circuit 
output 156a is derived as B,N(i) - DK(i) = BouT{i) for black level data DK(i) (the above state is called a black 
con-ecting mode). SImilariy. controls are also executed for a green signal Gin and a red signal R|n by signals 
77aG and 77aR. Control lines® ,(g) ,© .@ , and® of gates of the selectors for the above control are controlled 

55 by a CPU on the basis of a latch 85a assigned as an I/O of a CPU 207 (Fig. 12). By selecting B input tenmlnals 
of the selectors 82a, 83a, and 86a, the RAM 78a can be accessed by the CPU 207. 

Fig. 8 shows a construction of a white con-ection circuit In the black conrection/white conrection circuit 506a 
shown in Fig. 1. 
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In the white level correction (shading conrection), the original scanning unit Is moved to the position of the 
unifomi white plate and the original is illuminated. On the basis of the white color data obtained at this time, 
the illuminating system, the optical system, and a sensitivity variation of the sensors are corrected, 

A fundamental circuit construction of the whjte correction circuit is substantially the same as that shown in 
5 Fig. 6. In the black conrection, the correction has been executed by the subtracter 79a. However, in the white 
conrection, a multiplier 79'a is used and only this point is different. Therefore, the explanations of the same por- 
tions are omitted here. 

Upon color correction, when the color CCD image sensor 101 to read an original is located at the reading 
position (home position) of the unifonm white plate, that is. prior to the copying operation or the reading oper- 

10 ation, the exposing lamp (not shown) is lit on and the image data at a uniform white level is stored into a cor- 
rection RAM 78'a of one line. For instance, if there is a width in the longitudinal direction of the A4 size original 
in the main-scanning direction, there are 4752 (= 16 x 297 mm) pixels at 16 pel/mm, that is, a capacity of the 
RAM is set to at least 4752 bytes. As shown in Fig. 9. in the case of white plate data Wi (i = 1 to 4752) of the 
ith pixel, the data for the white plate is stored into the RAM 78'a every pixel as shown in Fig. 10. 

15 On the other hand, for a read value D| of an ordinary image of the ith pixel for W|, data Do after the correction 

should be equal to D, x FFh/W,. Therefore, gates 80'a and 81 'a are opened by the CPU 207 for® ',(g) ',© 
and® ' of a latch 85'a. Further, signals are supplied to selectors 82'a. 83'a, and 86'a so as to select B input 
tenminals, respectively, thereby enabling the CPU 207 to access the RAM 78'a. Subsequently, the CPU 207 
sequentially calculates FFA/V,. ... for FFh/Wq and FFh/W, for a head pixel Wq, thereby substituting the data in 

20 accordance with a procedure shown in Fig. 1 1 . After completion of the data substitution for the blue component 
of the color component image (step B), the processes are likewise sequentially executed for the green com- 
ponent (step G) and the red component (step R). After that, the gate 80'a is opened (§) ') and the gate 81'a Is 
closed (g) ') so that Do (= D, x FFh/W,) generated for the input original image data D,. The selectors 83'a and 
86'a select A input terminals. The coefficient data FFh/W| which has been read out of the RAM 78'a is trans- 

25 mitted along a path of the signal lines 153a 157a and is multiplied with the original image data 151a which 
has been supplied from one input terminal. The resultant data is generated. 

As mentioned above, by executing the corrections of the black level and the white level based on various 
factors such as black level sensitivity of the image input system, dark current variation of the CCD, sensitivity 
variation among the sensors, light amount variation of the optical system, white level sensitivity, and the like, 

30 image data Bqut 121. Gqut 122. and Rqut 123 which have been unifomily corrected every color for both of 
white and black are derived in the main scanning direction. The image data of R (red). G (green) and B (blue) 
each consisting of eight bits which have been subjected to the white correction and the black correction are 
subsequently supplied to a luminance signal generation circuit 108 and a color detection circuit 109 in Fig. 1. 
The luminance signal generation circuit 1 08 will be first-described. 

35 In the luminance signal generation circuit 1 08. an image which is not color separated and exists in a whole 

wavelength region, that is, a black and white image is produced from the color separated image which has been 
read by the color CCD image sensor 101. This is because the output means in the embodiment has only a 
monochromatic output means. In the luminance signal generation circuit 108. a calculation of the following 
equation is performed. 

^ Dataout = (R + G + B)/3 

That is. a mean value is calculated for the input R. G, and B data. In the embodiment, an adder and a multiplier 
have been used. The calculated luminance signal is sent to a selector 116. which will be explained hereinlater. 
In the embodiment, although the mean value of the R. G. and B data has simply been calculated, the luminance 
signal can be also obtained as Dataout = 0.30R + 0.59G + O.I IB or can be also derived by using only the G 

45 data. 

Fig. 12 shows a construction of the color detection circuit 109 shown in Fig. 1. 

The R. G, and B input data to the luminance signal generation circuit 108 are also supplied to the color 
detection circuit 109. In the embodiment, the hue signal has been used as a color detecting method. This is 
because even in the case where saturations and brightnesses differ even for the same color, it is necessary 
50 to accurately discriminate. 

The color detecting method will be first schematically explained hereinbelow. 

Each of the input R, G. and B data consists of eight bits and has information of total 22* colors. Therefore, 
if such a great amount of infonmation is directly used, the apparatus becomes expensive also in temns of a circuit 
scale. In the embodiment, the foregoing hue has been used. Although the above hue accurately differs from 
55 the hue which is generally expressed, it is called a hue here. As known by a Munseirs solid or the like, it is 
known that the color space is expressed by the saturation, brightness, and hue. The R. G. and B data first need 
to be converted into a plane, that is, two-dimensional data. Since the common portion of R. G. and B. namely, 
the minimum value min(R,G,B) of the R. G, and B data conresponds to the achromatic color component, the 
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minimum value min(R,G,B) is subtracted from each of the R. G. and B data and the remaining data are used 
as chromatic color components, thereby converting a three-dinr^nsional input color space into a two-dimen- 
sional color space. As shown in Fig. 13, the converted plane within a range from 0° to 360*^ is divided into six 
regions. The hue values are obtained by the Information of the order of the magnitudes of the input R. G, and 
5 Bdata, namely, the infomnation such asR>G>B. R>B>G, G>B>R. G>R>B. B>G>R. andB>R> 
G and by the maximum value and the middle value of the input R, G, and B data by using a lookup table (LUT) 
or the like. 

The operation of the color detection circuit 109 will now be described. 

The input R, G, and B data are first supplied to a max/mid/min detection circuit 201 to discriminate the mag- 
to nitudes of the R, G, and B data. Each of the input R. G. and B data is compared by using a comparator and 
the maximum (max) value, middle (mid) value, or minimum (min) value is generated in accordance with the 
result of the comparison. An output value of the comparator is generated as an order signal. For the max, mid, 
and min values generated, in order to subtract the achromatic color component from the max value and the 
mid value as mentioned above, the minimum (min) value is subtracted from the max value and the mid value 
15 by subtracters 202 and 203. Output signals of the subtracters 202 and 203 are supplied to a hue detection circuit 

204 together with the order signal. The hue detection circuit 204 is constructed by a memory device such as 
RAM, ROM, or the like which can be accessed at random, In the embodiment, a lookup table is constructed 
by using an ROM. Values corresponding to angles of planes as shown in Fig. 13 have previously been stored 
in the ROM. The hue value is generated from the ROM in accordance with the order signal (max - min) value 

20 and (mid - min) value which are input. The generated hue value is subsequently sent to window comparators 

205 and 206. Color data to be inherently pattemed is supplied to the comparators 205 and 206 firom data input 
means (not shown). Desired offset values are given to the hue data values according to the color by the CPU 
207 and the resultant values are set into the comparators 205 and 206. Assuming that a set value is ai, the 
comparator 205 generates a "1" signal for the input hue data when the hue data is smaller than the set value 

25 ai. Assuming that a set value is a2, the comparator 206 generates a "1 " signal when the hue data is larger than 
the set value aa. 
Therefore, when 

ai < hue data < 32 

a "1" signal is generated from the color detection circuit 109 by an AND gate 208 at the post stage. It will be 
30 obviously understood that a plurality of detection colors are set in the case of using a plurality of sets of window 
comparators. 

A discrimination signal indicative of the result of the discrimination by the color detection circuit 1 09 is sent 
to an AND gate 1 1 0 and the selector 116. The AND gate 1 10 calculates the AND of such a discrimination signal 
and a pattern signal which is generated from a pattern generation circuit 1 1 1 , which will be explained hereinlater. 
35 The selector 116 will be explained hereinlater. 

The pattem generation circuit 111 and an address control circuit 112 will now be described with reference 
to Fig. 14. 

The pattem generation circuit 111 has an ROM 705 in which pattem dot data conresponding to each hue 
has been stored. As shown in Fig. 15. data of "1" and "0" have been written in addresses conresponding to 

40 upper and lower addresses in the ROM 705. Fig. 16 shows a pattem which is formed by the above data. As 
shown in Fig. 14, address signals of the ROM 705 are formed by a main-scan counter 701 and a sub-scan 
counter 703 which are synchronized with the pixel clock VCLK and a scan reference signal HSYNC. Reference 
signals ITOP. HSYNC. and VCLK are timing signals as shown in Fig. 17. The ITOP signal is a signal indicative 
of an image edge and is seit to the low level while the scanner reads the image. The maim-scan counter 701 

45 counts the signals VCLK synchronously with the HSYNC signal. The sub-scan counter 703 counts the signals 
HSYNC synchronously with the ITOP signal, thereby forming an address in the pattem ROM 705. The pattem 
signal which has been used to calculate the AND by the AND gate 110 on the basis of the result of the dis- 
crimination by the color detection circuit 1 09 is supplied to a multiplier 1 13. by which it is multiplied to the video 
signal of min(R,G,B). The min(R,G,B) signal is a signal which is produced by the color detection circuit 109 

50 and is a signal indicative of the minimum value (dart^est) among the color separated video signals of the input 
R, G, AND B data. There is a case where the signal level of the signal which is fomried by the luminance signal 
generation circuit 108 differs depending on the color and, for instance, the signal level for the yellow color 
approaches white, so that the image data of the original lacks. The min(R,G,B) is provided to prevent such a 
case. 

55 The min(R,G.B) signal is also supplied to a contour extraction circuit 114, by which a contour is extracted. 

The contour is extracted by a Laplacian filter which is generally known. The extracted contour signal is added 
to the patterned min(R,G,B) signal sent from the multiplier 113 by an adder 115. That is, the contour signal 
indicative of the contour and shown in Fig. 1 8A is added to the min(R,G,B) signal indicative of the pattem and 
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Shown in Fig. 1 8B, so that the min(R,G.B) signal indicative of a trimmed pattern shown in Fig. 18C is derived. 
A signal generated from the adder 1 1 5 is subsequently transfenred to the selector 116. The foregoing luminance 
signal and the min(R,G,B) signal indicative of the trimmed pattern are given to the selector 116. The selector 
116 executes a switching operation on the basis of the result of the detection from the color detection circuit 
5 109. An output signal of the selector 1 16 is sent to a LOG conversion circuit 117 to convert the luminance signal 
into the concentration signal. The converted concentration signal is generated from the LOG conversion circuit 
117. 

By adding the contour signal to the image signal indicative of the pattern, an image as shown in Fig. 19B 
can be derived from an original of Fig. 1 9C. Even if the image has been pattemed, it can be expressed without 
10 making it hard to see the image. 

<Second embodiment> 

Fig. 20 shows the second embodiment of the invention. The embodiment relates to an example of an Image 
15 processing apparatus in the case where a white space is inserted into a contour portion. 

In Fig. 20, reference numerals 101 to 104. 117, and 133 denote the same portions as those in Fig. 1. The 
contour extraction circuit 114 executes a filtering process to perform a primary differentiating process to the 
min(R,G,B) signal. In the filtering process, an arithmetic operation is executed by using masks shown In Figs. 
21 A and 21 B. Fig. 21 A shows the mask to calculate a primary differential value for the main-scanning dirBction. 
20 The following calculation is performed. 

AH = D.-. .-i-D. .-+D. - 

3-1 ,x-l 3 , x-1 3 + 1, 1-1 



25 



-(D. - .-+D. , . ^ ) 

^ 3-1,1+1 3/i+l 3 + l»l-+l 

D . . = min (R. .,G. .,B. .) 
13 ^3' 13' 13' 



where, 

30 I : pixel number 

j : line number 

Fig. 21 B shows the mask to calculate a primary differentiation value for the sub-scanning direction. The follow- 
ing calculation is executed. 

3-1,1-1 3-1.1 3-1,1+1 

-(D-^.^+D.-.+D...') 
J+1,1-1 3+1/1 3+1,1+1/ 

40 Fig. 22 shows the relation between the input min(R,G,B) signal and the primary differentiation value in only a 
single direction. 

The value indicative of the sum of the absolute values of those primary differentiation values Is obtained 
as a primary differentiation value S. 

s = IahI + IavI 

45 A predetenmined slice level T is arbitrarily set for the value of S derived as mentioned above. A "0" or "1" 

signal is generated on the basis of the following conditions. 

S > T ... 0 signal 
S ^ T ... 1 signal 

Figs. 23A and 23B show examples of a primary differentiation value and an output signal. The AND of the output 
50 signal and the pattemed min(R,G,B) signal is subsequently calculated by an AND gate 128. That is. in the edge 
portion of S > T, the patterned min(R,G.B) signal is masked and is supplied to a selector 129. As shown in Figs. 
24A to 24C, in an image which has simply been patterned as shown in Fig. 24Afrom an original of Fig. 24C, 
a white portion is fonmed between the pattern and a non-pattem as shown in Fig. 24B, so that the non-pattem 
portion can be easily seen. 

55 Although an example in which two filters are used as a contour extraction circuit 1 14 has been described, 

it is also possible to cope with both of the main-scanning directton and the sub-scanning direction by one filter. 

On the other hand, to enable an edge to be easily discriminated, the maximum value signal (max signal) 
can be also used in place of the minimum value signal (min signal) or the luminance signal can be also used. 
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< Third Embodiment> 

Figs. 25-1 to 25-2 show the third embodiment of the invention. The embodiment relates to an example In 
the case where a white blank contour is provided between a black character and a pattern and a black contour 
5 Is provided between the pattern and a white image and a white contour is provided for the inside (pattern side) 
of the black contour. 

Fig. 25-1 is a block diagram showing a construction of a contour process in the third embodiment. Since 
a circuit construction until the luminance signal generation circuit 108. the pattern generation circuit 111, and 
the address control circuit 1 12 are similar to the foregoing first and second embodiments, their descriptions 
10 are omitted here. A color detection circuit 259 will be first explained with reference to Fig. 25-2. The color detec- 
tion circuit 259 is fundamentally similar to the color detection circuit 109 in the first and second embodiments. 
However, a circuit to obtain an achromatic color signal is added in addition to the circuit 109 in the first and 
second embodiments. An output of the subtracter 202 to subtract the minimum value from the maximum value 
is supplied to a comparator 209-a and is compared with a value which has been set by the CPU (not shown). 
15 A comparison result is generated from the comparator 209-a. That is. when a difference between the maximum 
value and the minimum value of the input R, G. and B data is small, the pixel data is detenmined to be an 
achromatic color. The color detection signal detected by the color detection circuit 259 on the basis of the input 
R. G. and B data is supplied to a contour extraction circuit 250 in Fig. 25-1 and as a selection signal to a pattem 
synthesis selector 251 . The output signal from the luminance signal generation circuit 1 08 and the output signal 
20 from the pattern generation circuit 1 1 1 are given to the selector 251 . When the color detection signal is at the 
"1^ level. In other words, when a predetenmlned color has been detected, a B input temrilnal Is selected. If no 
color is detected, an A Input terminal is selected, namely, the luminance signal firom the luminance signal gen- 
eration circuit 108 is selected. 

The contour extraction circuit 250 extracts three kinds of contour signals shown in Figs. 26A to 26C from 
25 the input luminance signal and color detection signal. Fig. 26A shows the contour signal to form a white blank 
portion at a boundary between the patterned Image and a black character. Fig. 26B shows the contour signal 
to form a black contour between a pattem which has been obtained by patteming a predetemnined color and 
a background bright image. Fig. 26C shows the contour signal to further add a white contour to the inside of 
the black contour of Fig. 26B. Fig. 26C is provided to obtain a middle blank line for an image with a narrow 
30 image width such as a thin line or the like expressed by a predetermined color. The construction and operation 
of the contour extraction circuit will be explained in detail hereinlater. 

The above contour signals are respectively supplied to selectors 252 to 254 to add the contour signals to 
the image data. The image signal is given to an A input terminal of each of the selectors 252 to 254. Predeter- 
mined values which have been set in registers 255 to 257 by the CPU (not shown) are given to B input tenminals 
35 of the selectors 252 to 254. Each selector switches the image signal and the predetermined value on the basis 
of the contour signal. The selector 252 generates the image shown In Fig. 26A. The selector 253 generates 
the image shown in Fig, 28B. The selector 254 generates the image shown in Fig. 26C. 

The contour extraction circuit 250 will now be described with reference to Figs. 27, 28, and 29. 
The luminance signal generated from the luminance signal generation circuit 108 is binarized by a com- 
40 parator 270. Fig. 28 shows examples of outputs. A slice level for binarization is set into a register 271 by the 
CPU (not shown). An AND gate 287 calculates the AND of the binarized signal and the achromatic color signal. 
That is. the AND gate 287 generates a "1" signal in the case where the image has an achnDmatic color and a 
predetermined concentration. The AND gate 287 generates a "0" signal in the other cases. The output signal 
is delayed by a predetemnined number of lines (minimum six lines) by a line memory 272. The delayed signal 
45 is sent to an OR circuit 273 to calculate the OR of 7 x 7 pixels. A signal which has been expanded by a pre- 
determined number of pixels by the OR circuit 273 and a target pixel signal which has been delayed by a pre- 
determined number of pixels by a delay circuit 274 are supplied to an EX-OR gate 275 to calculate the EX-OR. 
Thus, the EX-OR gate 275 generates a contour signal indicative of a contour portion of the image having an 
achromatic color concentration. The output signal of the AND gate 287 and the color detection signal are sent 
50 to an OR gate 277. by which the OR is calculated. An output signal of the OR gate 277 is delayed by a pre- 
detennined number of lines (six lines or more) by a line memory 278. After that, the delayed signal is supplied 
to a circuit 279 comprising an AND circuit 279a to calculate the AND of 7 x 7 pixels and an AND circuit 279b 
to calculate the AND of 5 x 5 pixels. The signal is thinned by a predetermined number of pixels by both of the 
AND circuits 279a and 279b. Output signals of the AND circuits 279a and 279b are supplied to an EX-OR gate 
55 280. A signal as shown in Fig. 29 is obtained from the EX-OR gate 280. The color detection signal is delayed 
by a time corresponding to a predetermined number of lines by a line memory 284 and is. further, delayed by 
a time coaesponding to a predetermined number of pixels by a delay circuit 285. After that, an output signal 
of the delay circuit 285 and the output signal from the AND circuit 279b of 5 x 5 pixels are supplied to an EX-OR 
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gate 282, so that a signal shown in Fig. 29 is generated from the EX-OR gate 282. Output signals from the 
EX-OR gates 275. 280, and 282 are supplied to AND gates 276, 281, and 286, from which an in-color black 
character contour portion signal, a color contour signal, and an in-pattem white blank signal are derived. Those 
signals are supplied to the selectors shown in Fig. 25-1 and each contour data in the pattern shown in Fig. 26C 
5 is added to the read image. 

The trimming process can be also executed by one or two of the in-color black character contour portion 
signal, the color contour signal, and the in-pattem white blank signal as necessary. 

<Fourth embodiment> 

10 

The case of adding a contour to a boundary portion between colors when different patterning processes 
are executed to a plurality of colors will how be described with reference to Fig. 30. With respect to the color 
detection circuit, a plurality of sets of window comparators are provided for an output of the hue detection circuit 
204 to execute the discrimination as shown in Fig. 12 and a plurality of different colors are detected by using 

15 the color detection signals as a plurality of bits. With regard to the pattern synthesis as well, there are provided 
selectors which generate different patterns in accordance with states of a plurality of bits. Therefore, the pattern 
generation circuit has a plurality of pattem generators. The description regarding the detailed circuit operation 
is omitted here and only the contour extraction circuit will now be explained. 

In the embodiment, recognition codes of eight colors, that is, color codes of 3 bits are provided. For COLA 

20 (0 - 2) shown in Fig. 30, COLB (0 - 2) denotes a signal which has been delayed by one line by a line memory 
(not shown) and COLO (0 - 2) denotes a signal which has. further, been delayed by another one line. The res- 
pective input signals are delayed by predetenmined pixels by flip-flops 301a to 303a That is, a matrix of 3 x 3 
shown in each of Figs. 31 A to 31 D is constructed. Those signals are supplied to equal-plane comparators 304a 
to 304d each of which generates a "1 ** signal when both of input signals are equal, by which checks are made 

25 to see if the discrimination colors differ or not with respect to four kinds of directions shown in Figs. 31 A to 31 D, 
respectively. Output signals from the comparators 304a to 304d are wavefonn shaped by a flip^op 305 and! 
after that, they are sent to a 4-input NAND circuit 306, from which a color boundary signal Is generated. That 
is, if the discrimination color code in even one of the four directions shown in Fig. 31 differs, a color boundary 
is determined and a color boundary signal serving as a contour signal is generated. 

30 Fig. 31A shows the matrix to discriminate whether the colors before and after a target pixel are Identical 

or not. Fig. 31 B shows the matrix to discriminate whether the colors over and under the target pixel are identical 
or not Figs. 31 C and 31 D show the matrices to discriminate whether the color codes in the oblique directions 
are identical or not, respectively. The color boundary signal which has been discriminated as mentioned above 
is supplied to the selector to add a contour. Since a method of adding a contour to the Image signal Is substan- 

35 tially similar to that of the third embodiment, its description is omitted here. According to the fourth embodiment, 
as shown In Fig. 328, the boundary between the first and second colors is clearer as compared with the case 
of Fig. 32A and the color image of the original image of Fig. 32C can be easily discriminated. 

As described above with respect to the first to fourth embodiments, the color image portion of the original 
image can be easily distinguished from the other image portion. 

40 Alttiough a predetenr^ined color of the color image has been patterned in the embodiments, the hue can 

be also controlled by a concentration level instead of the pattern. Such a confrol has been described in detail 
in U.S. Patent Application Serial No. 664,934 (filed March 5. 1991) conresponding to Japanese Patent Appli- 
cation No. 2-51644 (1990). 

The invention is not limited to the case of printing by the printer but can be also applied to various apparat- 
us uses as in the case of displaying by a display, the case of transmitting by a facsimile apparatus, the case of 
storing into a file, and the like. 

As described above, according to the invention, since the boundary between the color discrimination image 
and the other image has been trimmed, there is an advantage such that the image such as a character or the 
like which has conventionally been hard to see when the discriminating process had been executed can be 

50 made easy to see. 

The present invention is not limited to the foregoing embodiment but many modifications and variations 
are possible within the spirit and scope of the appended claims of the invention. 



55 Claims 

1. An image processing apparatus comprising: 

color discriminating means for discriminating a color of an input image; 
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discrimination image generating means for generating a color discrimination image in accordance 
with a result of the color discrimination by the color discriminating means; and 

trimming processing means for trimming a boundary portion between the color discrimination image 
generated by the discrimination image generating means and another image. 

^ 2. An apparatus according to claim 1 , wherein the trimming processing means fonms a blank portion in the 
boundary portion between the color discrimination image and another image. 

3. An apparatus according to claim 1 . wherein the trimming processing means forms a boundary line in the 
10 boundary portion between the color discrimination image and another image. 

4. An apparatus according to claim 1 . wherein said another image is an image other than the color discrimi- 
nation image which is generated by the discrimination image generating means. 

5. An apparatus according to d aim 1. wherein said another image is another color discrimination image which 
is generated by tne discrimination image generating means. 

6. An apparatus accord ng to claim 1 . wherein the trimming processing means trims a portion in the color 
discrimination image in the boundary portion. 

7. An apparatus according to daim 1 . further comprising; 
generating means for generating a luminance signal from the input image; and 
combination means for obtaining a combined image from the luminance signal and the color dis- 
crimination image. 

8. An apparatus according to daim 7. wherein the combination means has selecting means for selecting one 
of the luminance signal and the color discrimination image. 

9. An apparatus according to daim 1 , wherein the discrimination image generating means generates a pat- 
30 tern image having a predetermined pattern. 

10. An image processing method comprising the steps of. 

discriminating a color of an input image; 

generating a discrimination image whose color can be discriminated in accordance with a result of 
35 the color discrimination; and 

trimming a boundary portion between the discrimination image and another image. 

11. A method according to daim 10. wherein in said trimming step, a blank portion is fomned in the boundary 
portion between the discrimination image and said another image. 

12. A method according to daim 1 0. wherein in said trimming step, a boundary line is fomned in the boundary 
portion between the discrimination image and said another image. 

13. A method according to claim 10, wherein said another image is not said color discrimination image. 

14. A method according to daim 10. wherein said anothermethod is further another colordiscrimination image. 

15. A method according to claim 10. wherein in said trimming step, a portion in the color discrimination image 
in the boundary portion is trimmed. 

16. A method according to claim 10. further comprising the steps of: 
generating a luminance signal from the input image; and 

obtaining a combined image from the luminance signal and the color discrimination image. 

17. A method according to claim 10. wherein in said combining step, one of the luminance signal and the color 
discrimination image is selected. 

18. A method according to daim 10, wherein in said discrimination image generating step, a pattern image 
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having a predetermined pattern is generated. 

19. An image processing apparatus wliich detects a color in an input image and outputs a pattern at the image 
portions where the said color is detected, characterised in that the apparatus detects contours in the input 
image and provides a contour emphasis output at the image portions where a contour is detected. 

20. An apparatus according to claim 19, in which the contour emphasis output is a black or a white line or 
space. 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



12 



ISDOCID: <EP 0463844A2J_> 



EP 0 463 844 A2 



O 

CO 

a: 

UJ 



id 

u; 



UJO 




oc 

LJ \ 
UJ |< 

UJ 

CO 

: CD 



I 



in 



m 



o 

St; 

o< 




IS 



r 



UJ oc 

<UJ^ 



CM 



too 



1. ^ 



OUJ^ 



TUT 



vO 
O 



II II 



a 
< 



n. 



tn 



in 


in 


ro2 


-2 

in 


in 



un 



13 



JSOOCID: <EP 0463844A2_L> 



EP 0 463 844 A2 




ISDOCID: <EP 0463844A2_I_> 



EP0 463 844 A2 




O 



ro 

■ in 



16 



JSDOCID: <EP 04e3844A2J_> 



EP 0 463 844 A2 




ISDOCID: <EP_0463844A2J_> 



EP 0 463 844 A2 




18 



JSDOCID: <EP 0463844A2J_> 



EP O 463 844 A2 



FIG. 7 

OUTPUT f 

(WHITE) \ I 




001 -I— I ' -J — ■ J ' — 

(BLACK) CHI CH2 CH3 CH4 CH5 



FIG. 10 



Wo 


Wi 




Wi 








W(,752 















^0 










^752 



19 



EP 0 463 844 A2 



CM 




20 



JSDOCID: <EP 0463S44A2J_> 



EP 0 463 844 A2 



FIG. 11 




Step R 



21 



EP0 463 844 A2 




22 



4SDOCID: <EP 0463844A2_L> 



EP 0 463 844 A2 



MAGENTA 




YELLOW 



CYAN 



FIO. /4 



<701 



RC 

MAIN-SCAN 
COUNTER 




VCLK 
702 



^03 



RC 

SUB-SCAN 
COUNTER 




HSYNC 
•704 



ITOP 

23 



ROM 



EP 0 463 844 A2 



UPPER 

ADDRESS 



FIO. 15 

LOWER ADDRESS 





0 


1 


2 










7 


0 


1 


0 


1 


0 


1 


0 


1 


0 


1 


0 


1 


0 


1 


0 


1 


0 


1 


2 


1 


0 


1 


0 


1 


0 


1 


0 


3 


0 


1 


0 


1 


0 


1 


0 


1 


4 


1 


0 


1 


0 


1 


0 


1 


0 







FIG. 16 

MAINSCAN 



SUBSCAN 



25 



?5 



1 




1 



1 



i22 




24 



.0463844A2_I_> 



EP 0 463 844 A2 



ITOP 




HSYNC n 



VCLK 



_n_rLrLn^ 



^rLTLru 



FIG. 18A 




FIG. 18B 



,ll 



PI 



Ik 



FIG. 18C 



Ik 



25 



4SOOCID: <EP p463844A2J_> 



EP O 463 844 A2 



FIG. 19C 



ORIGINAL 



FIG. 19A1 

PATTERN NON PATTERN 



FIG. 19A2 

PATTERN PATTERN 





FIG. 19B 




26 



EP 0 463 844 A2 






in 


in 


in 


in 
in 



27 



iSDOCID: <EP 0463844A2J_> 



EP0 463 844 A2 



FIG. 21 A 

MAINSCAN 



FIG. 2 IB 



SUBSCAN 



i-1 


1 


i+1 




i-1 


i 


i+1 




1 


0 


-1 


j-1 


1 


1 


1 


j-1 


1 


0 


-1 


j 


0 


0 


0 


j 


1 


0 


-1 


j*1 


-1 


-1 


-1 


j*1 



MIN(R,Q, B ) 



PRIMARY 
DmRENTIAnON. 



FIG 22 



1} 



28 



4' A 



€P0 463 844 A2 



F IG. 23A 



PRIMARY 1--^ V--V SLICE LEVEL T 

DIFERENTIATION — 
VALUE 



FIG. 23B 



OUTPUT 
SIGNAL 



- H 

L 



FIG. 2UC 

PREDETERMINED COLOR 



■BLACK 



ORIGINAL 



FIG. 21* A 

NON PATTERN PATTERN 



FIG. 2UB 





29 



ISDOCID: <EP 0463844A2J_> 



EP 0 463 844 A2 




ISDOCID: <EP 0463844A2J_> 



EP 0 463 844 A2 




JSDOCID: <EP_0463844A2_!_> 



EP 0 463 844 A2 



FIG. 26A 



BLACK 



IN- COLOR 

BLACK 

CHARACTER 




CONTOUR 
SIGNAL 



32 



' 0463844A2J_> 



1 



EP 0 463 844 A2 



FIO. 26B 



BLACK 




BLACK 



WHITE 




PATTERN 



JUL 



Jl 



Jl 



33 



4SDCXID- <EP_0463844A2J_> 



EP0 463 844 A2 



F/O. 26C 



BLACK 




WHITE 
COLOR 




4 



EP 0 463 844 A2 




4SDOC1D: <EP 0463S44A2_I_> 



EP0 463 844 A2 



FIG. 28 





BLACK COLOR 


WHITE 















ACHROMATIC | 1 

COLOR SIGNAL » ' — 

OUTPUT SIGNAL | — 

OF COMPARATOR 270 ' 

OUTPUT OF AND 287 , | "~| 

OUTPUT OF OR CKT 273 | [ 

OUTPUT OF EXOR 275 f l (— [ 



36 



' 0463844A2_L> 



4 » 

BP 0 463 844 A2 



FIO. 29 





BLACK COLOR 


WHITE 















COLOR DETECTION | "T 1 ^ 

SIGNAL 

OUTPUT OF AND GATE 287_ J ' ■ 

OUTPUT OF OR GATE 277. I ' 

OUTPUT OF 7x7 AND CKT . I I— 

OUTPUT OF 5x5 AND CKT J L 

OUTPUT OF EXOR 280 JL ■ H- 

OUTPUT OF EXOR 282 H — T 



37 



JSDCCKJ: <EP__'0463844A2J_> 



EP 0 463 844 A2 



— I=>C3 



CO 

<=> 

CO 



1 




EP 0 463 844 A2 



FIG. BIA FIG.31B FIG.31C FIG. 31D 




FIG. 32C 

FIRST COLOR SECOND COLOR 




ORIGINAL 



FIG32A FIG. 32 B 

FIRST PATTERNING 




39 



4SDOCID: <EP__0463844A2J_> 



J 



Europaisches Patentamt 
European Patent Office 
Office europ^en des brevets 




@ Application number : 91305710.5 
@ Date of filing : 24.06.91 



@ Publication number : 0 463 844 A3 

EUROPEAN PATENT APPLICATION 

@ Int. Cl.^ H04N 1/46 



^ Priority : 25.06.90 JP 164316/90 

GS) Date of publication of application : 
^ 02.01.92 Bulletin 92/01 

(S) Designated Contracting States : 
^ DE FR GB IT 

^is) Date of deferred publication of search report : 
14.10.92 Bulletin 92/42 

^ Applicant : CANON KABUSHIKI KAISHA 
30-2, 3-chome, Shimomaruko, Otita-l(u 
Tokyo (JP) 



ffi) Inventor : Ichikawa, HiroyukI, do Canon 
Kabushiki Kaisha 
30-2, 3-chome, Shimomaruko 
Ohta-ku, Tokyo (JP) 
Inventor : Isemura, Keizo, c/o Canon 
Kabushiki Kaisha 
30-2, 3-chome, Shimomaruko 
Ohta-ku, Tokyo (JP) 

@) Representative : Beresford, Keith Denis Lewis 
et al 

BERESFORD & Co. 2-5 Warwick Court High 
Hoibom 

London WC1R 5DJ (GB) 



@ Image processing Apparatus. 
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